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J. R. Pierce has recently proposed a system for synchronizing an arbi- 
trary number of geographically separated oscillators, and, under the as- 
sumption of zero transmission delays between stations, has shown that a 
certain linear model of the system is stable in the sense that all of the station 
frequencies approach a common final value as t — > =o . 

This paper reports on some results concerning the dynamic behavior of 
Pierce's linear model. The results take into account transmission delays. 
More explicitly, we prove that if a certain set of simple inequalities in- 
volving the delays is satisfied, then the system is stable and the oscillator 
frequencies approach their common final value at an exponential rate. 
These inequalities have the property that they are always satisfied for 
sufficiently small delays. This paper presents a simple example showing 
that the system can be unstable when the inequalities are not met. In addi- 
tion, we present some information concerning the rate of decay of the 
natural modes of stable systems, discuss an alternative stability criterion 
not involving the transmission delays and derive an explicit expression 
for the final frequency. Finally, we discuss the mathematical relationship 
between Pierce's model and earlier models of synchronization systems. 

I. INTRODUCTION, DISCUSSION, AND SUMMARY OF RESULTS 

1.1 The Model 

It is well known that the problem of synchronizing the frequencies 
of geographically separated oscillators is of importance in connection 
with the detection and switching of pulse-code-modulated signals. 

J. R. Pierce has recently proposed a system for synchronizing digital 
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transmission networks* The system uses oscillators of adjustable rate 
of change of frequency, buffers which accept pulses at an incoming 
rate and which produce corresponding output pulses at the local clock 
rate, and adequate delay at each station to enable PCM frames to 
be properly aligned in time. 

In Pierce's model the content b it of the buffer at station i which 
accepts pulses from station ; is assumed to satisfy the equation,* 

tm = h - U 0) 

in which /,- and /> are the frequencies at stations ; and i, respectively, 
and the overall system of coupled oscillators is assumed to be governed 
by the equations 

fi = ctfoi ~ /,) + £ Oiihi i - 1, 2, • • • , n (2) 

for t ^ 0, where n is the number of stations, each c, is a positive constant, 
f 0i is the center frequency of the oscillator at station i, and each a,, 
is nonnegative and satisfies a,-,- = a,-, . 

In his discussion of equations (2), Pierce assumes that the trans- 
mission delay between stations i and j can be neglected for all i 9^ j, 
in which case equation (1) can be interpreted as 

6«(0 = /,(*) - 1S), t £ (3) 

instead of as 

ha(t) = hit - r,,-) - /,(*), t* (4) 

with each t« a nonnegative constant. Under the natural assumption 
that there is some path from each station to every other station, 
Pierce has shown, by directing attention to a passive RLC net- 
work analog of the equations,* that the system is stable in the 



* The system is described in an unpublished memorandum which, after this 
paper was written, was considerably expanded and then published. 1 Since the 
memorandum did not explicitly consider the "C = system" of Ref. 1, it is not 
mentioned above. A nonlinear version of the "C = system" is considered in 
some detail by. this writer in a paper to be published. 

t A dot over a mathematical symbol denotes the derivative with respect to 
time. . ,. 

The number 6<jU) denotes, to within an additive constant, an approximation 
to the product of a fixed constant and the number of pulses stored in the ijth 
buffer at time t. tl 

t In the Laplace-transform domain, the equations can be written as the 
system of equations sF + CF + s^AF = G, in which F is the transpose of the 
Laplace transform of (/1, /a, . . ., In) and (with a set of common-ground node- 
voltage equations analogy in mind) C and A may be interpreted as a diagonal 
conductance parameter matrix and an elastance parameter matrix, respectively. 
The "source vector" G takes into account initial conditions, the values of the 
center frequencies, and the values of the constants c ( . 
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sense that each frequency /, approaches the same final frequency as 
t — > oo.* 

1.2 Example of An Unstable System 

We wish to show now that if transmission delays are taken into ac- 
count, then the system described above need not be stable. Consider 
the equations of a two-station sj'stem with c x = c 2 = c, a 12 = a 2 \ = a, 
and r 12 = t 2 i = f(c, a, f > 0): 

fi+ch + CL f [/,(r) - U(r - ?)] dr = o& 12 (0) + c/ 0l 

h +cf 2 + a f [/ 2 (r) - f,(r - f)] rfr = a& 21 (0) + c/ 02 
•'o 

for £ Si 0. It is not difficult to verify that these equations posses a 
solution 

U(t) = Re M'-'] h(t) = Re [y 2 e ,u '] 

for t Si — f with v, , v 2 , and u^O constants if and only if 

— a Re [(», - y 2 e"' u? )(to) _1 ] = ab 12 (0) + c/ 01 (5) 

-a Re [(», - Pi«"'" f )(*»)" 1 ] = «&2i(0) + c/ 02 (6) 

and Mv = 0, in which v is the transpose of (v^ , v->) , is the zero 
2-vector, and 

— co -f- iuc + a — ae 

— ae~' UT —u> 2 + iuc + a_ 



M = 



Thus if det M = for some real value of « ^ 0, then the system is 
unstable in the sense that for some values of the right sides of equations 
(5) and (6) there exists a pair of real-valued functions /,(•) and / 2 (-) 
such that the equations are satisfied for all t ^ 0, and at least one of 
these functions does not approach a limit as t — > oo . Moreover, if 
for example to 2 = a, c 2 = a, and tor = \t, then det M = 0, which shows 
that the two-station system can be unstable if additional restrictions 
are not imposed on c, a, and f. f 

* He has also exploited the network analogy further in order to obtain an 
expression for the final frequency and to make assertions concerning the be- 
havior of the system when certain elements are nonlinear. 

t Note that /iU) or } s (t) can be negative in this example. While it is cer- 
tainly true that instantaneous frequencies are not negative, our analysis is in- 
tended to show only that the solution of the equations can possess a sinusoidal 
mode. Thus, the conclusion and the essential details of the analysis are unchanged 
if we add a constant u to /i(0 and f%(t) provided that we subtract the constant 
cu from the right side of equation (5) and the right side of equation (6). 
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1.3 Summary of Results 

The purpose of this paper is to report on some results concerning 
the dynamic behavior of Pierce's model. The results take into account 
transmission delays. In particular, we prove that the (assumed con- 
nected) system is stable whenever 

c, > £«*#*(*#+ O f-1,2, ••• ,n. (7) 

In fact we prove that if condition (7) is satisfied, then the frequencies 
fi approach their final value P at an exponential rate.* Concerning 
the final frequency P , we derive the explicit expression 

E Cifa +EE «•• A/(0) +IE «..- f fM du 

i t iVi 

This paper also presents some material concerning bounds on the 
rate of decay of transients in stable systems. More explicitly, we 
derive a lower bound on the rate of decay of all complex natural 
modes. 

We prove also that the system is stable whenever 

CfcflEo,,) 1 *-l,2, ...,n (9) 

and that if condition (9) is satisfied, then [as in the case of condition 
(7) ] the frequencies /* approach P at an exponential rate. 

Unlike condition (7), condition (9) is obviously not always satis- 
fied for sufficiently small delays. On the other hand, if condition (9) 
is satisfied, then the system is stable independent of the values of the 
m. In this sense the results corresponding to conditions (7) and (9) 
are complementary. 

Our results described above are stated in a more precise manner 
in Section II, and proofs are given in Section III. 

1.4 The Relation to Earlier Work 

The system governed by equations (2) and (4) is closely related 
to synchronization systems which have been studied earlier. This re- 
lation is made clear as follows. From equations (2) and (4) 



* Of course in the vast majority of cases it is reasonable to assume that m = 
th for all i ^ j. We have proceeded without this assumption in order to show- 
that our stability result is not critically dependent on it. 
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Si = C,(/o, - /,) + E *u f Ui(r ~ r,,) - /,(r)] dr 

+ EaoMO) * = 1,2, ••• ,n (10) 
for all t ^ 0. We write equations (10) as 

/, + C t U = E On [' [fiir ~ r„) - Mr)] rfr + C,/„, 

(Hi •'O 

+ Efli/MO) *- 1,2, ... ,n (11) 

for all t ^ 0. Then, treating the right sides of equations (11) as "driving 
functions," we can solve the n first-order differential equations (11) 
to obtain 

/,• = f exp [- Ci (t - U )] E a ti f [/,(r - r,,) - /,(t)] rfr dw 

•'0 j*i Jo 

+ /,(0) exp (-c.O + / exp [-<?,(* - T )][ Ci 1 0i + E a.A,(0)] dr 

JO j+i 

for all i and all « ^ 0. But 

J o Mr - r,,) dr = J ' /,(r) dr + j f,(v) dv 
for all j and all u ^ 0. Thus, with 

Pi(.t) = f 1M dr 
for all i, we have (after some simplification) 

P.- = f k t (t - r)^Z aii [ Pi (r - r i; ) - p,(r)] dr 

+ v { +«,(0, «£ * = 1, 2, ... ,n (12) 

in which each v t is a constant and each Ui(t) approaches zero as 
t-> oo. More explicitly, ki(t) = exp(— ctf), 

Vi = Ui + (c,)" 1 E «.,- ( //(«) du + &,,(0) 1 , 

andui(i) = [/i(0) - i/,] exp (-erf)- 

Equations of the same type as (12) have been studied extensively 
in connection with linear models of synchronized networks, and many 
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interesting and informative results have been obtained (see Refs. 2-6) . 
In particular, Benes has derived a sufficient condition for stability 
(see Refs. 2 and 3) . His condition does not depend on the delays and is 
therefore of a very different type than condition (7). When applied 
to our system of equations (10) via the relation between equations 
(10) and (12), Benes' condition reduces to our condition (9).* It 
therefore does not yield Pierce's result obtained via the network 
analog. 

As is often true of pioneering work, Benes' proof is long and in- 
volved. Our derivation of what amounts to his condition applied to 
our system is relatively simple and is much less involved compared 
with the rather long proof of our main result which asserts that if 
condition (7) is satisfied, then the system is stable. To a consider- 
able extent, the methods of proof used here are very different from 
those of earlier writers concerned with the synchronization problem, 
and they provide some grip on the problem of estimating the rate of 
decay of the natural modes of the system. On the other hand, in this 
paper we do not consider several other important practical problems 
such as that of obtaining a useful upper bound on the contents of the 
buffers or of predicting the effects of variable transmission delays (re- 
sulting from temperature changes). There is a clear need for much 
more work in this area, especially in connection with models which 
take into account purposely-inserted nonlinearities. 

II. STATEMENT OF RESULTS 

2.1 Definitions and Assumptions 

Let M denote an arbitrary complex matrix. We denote by M tr and 
M* the transpose of M and the complex-conjugate transpose of M, 
respectively. If M is not a row vector or a column vector, then (M)u 
denotes the i;th element of M. If M is a column vector then (M) ; - 
denotes the ;'th element of M . If M is square, then M u - }) denotes the 
matrix obtained from M by deleting the ;'th row and column. The zero 
element of complex Euclidean n-space is indicated by $, and 1„ denotes 
the identity matrix of order n. 

* Benes proves that a suitable equilibrium state is approached. He makes no 
assertions concerning the rate at which it is approached. However, it is possible 
to modify the alternative proof 3 of Benes' result due to Gersho and Karafin to 
show that the equilibrium state is approached exponentially under reasonable 
additional assumptions. For example, it suffices to assume that each transfer 
function H t (s) of Ref. 3 is a rational function of s. See the appendix. 
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The statement "for all i" means for all i = 1, 2, • • • , n in which n 
denotes an arbitrary fixed positive integer (the number of geographically 
separated stations) such that n ^ 2. If /,• or F = (fi , f 2 , • • • , /„)' r 
denotes a differentiate function of t or a differentiable n-vector-valued 
function of t, then /, or F indicates the derivative with respect to t of 
/, or F, respectively. 

We assume throughout the paper that 

(i) A is the real n X n matrix defined by 

(A) u = 2>„- for alii (13) 

(A) if = -an foralH^;' (14) 

in which a lf - = a,, ^ 0, for all i ^ j. 

(ii) detA (B "° > (15) 

(Hi) th ^ for all i ^ ; (16) 

(iv) the operator A is a mapping of the set of n-vector-valued functions 
of t into itself defined by the condition that if F(t) = [f l (t), j 2 (t), • • • , 
/„(<)]", then 

[(AF)(t)]i = E «.y[/.(0 - Ut ~ t«#)] (17) 

for all i. 

(v) C = diag (c, , c 2 , • • • , c n ) with c,- > for all i 
(vi) A is the complex n X n matrix defined by 

&)u = Efl< ( for all* (18) 

(K)i,- = — a tl exp (—STu) for all i 9^ j and all complex s (19) 

(vii) A(s) denotes the determinant det [s 2 l„ + 8(7 + A]. 

Assumption (ii) is satisfied if there exists a path (not necessarily a 
direct path) from each station to every other station.* 

* This proposition is a spot- ial case of a known result in probability theory. A 
simple proof is given in Ref. 3. A "network theoretic" proof is as follows. The 
matrix A may be interpreted as the indefinite conductance matrix of a non- 
negative element ?i-node resistance network, and A ,n - "' is the node-pair con- 
ductance matrix of the network obtained by grounding node n. If the original 
7i-node network is connected, then the common-ground network possesses an 
open-circuit resistance matrix, which means that det A' n - "' =7^ 0. But, since the 
network contains only nonnegative elements, det A' n - "' > 0. 
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The equations of our system are 

fi = c,(/o, - U) + E «.i f Mr ~ *<i) ~ tMl d7 

+ E aubiM, l ^ ° 

for all i. Therefore, with F = (/i , / a ,•• •,/„)", we have 

F + CF + AF = 8, t^O. 

2.2 Results 

Theorem 1 is the principal result of this paper: 

Theorem 1: Let F(-) be a twice differentiable n-vector-valued function 
defined on[-f, »), in which f = max lVj - {t,-,}, such that 

F + CF + AF = 8, t £ 0*. 

If 

/or all i, then there exist a constant p, positive constants fi and y, and an 
n-vector-valued function (?(•) defined for tz[Q, oo) such that 

| [G(t)]< | ^ /Se" 7 ', * ^ 

/or aZZ ■&', and 

F(t) = G(«) + P (1, 1, ■••,!)" 

for all t ^ 0. 

Some information concerning the rate of decay of the complex natural 
modes of the system, assuming that the stability condition of Theorem 1 
is satisfied, is provided by the following theorem. 

Theorem 2: Let t,-,- = t,-, for all i 9^ j. If there exists a positive constant 
8 such that 

Ci - X) a n r *i = 8 

for all i, and if A (a) = with Im [s] 9± 0, then Re [s] ^ -a in which 
a is the solution of 

— 2a + max c, = [max c, — 5] exp (a f) 



* Questions concerning the existence and uniqueness of solutions of equations 
of this type are discussed in Ref. 7. 
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where f = max,-,*/ {t,/}. 

An expression for the final frequency p of the system is given in 
Theorem 3: 

Theorem 3: If F(-) is differentiable on [ — f, <») with f = max, Vf - {r, y } 
such that for all i 

f< = c,(/ ,. - /,) + £ a,, f [/,(r - r,-,-) - /,(r)] dr 

+ Z <*«MP)i i ^ 

in which the f oi and the 6,,(0) are constants, and if there exists a constant p 
such that for all i: (/< — p) — > as t — > » , and (/,• — p) z's (absolutely 
integrable on [0, <*>), then 

£ c,/o, + EE a.-,fe.-,(o) +IE «.« f //(*) dw 

Our final result is as follows. 

Theorem 4: The statement obtained from the statement of Theorem 1 by 
replacing the condition that 

c, > 2 o-ahirn + T a) for all t 
by the condition that 

Ci ^ (2 2 ««)* for all * 

is a theorem. 

in. PROOFS 

3.1 Proo/ of Theorem 1 

Our proof consists of proving the following four lemmas. 
Lemma 1: A (s) has a simple zero at s = 0. 
Lemma 2: If 

/or i = 1,2, • • • ,n Me// 
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(*) A(s) ^ 0/orRe[s] > 

(ii) there exists a positive constant a such that if A(s) = with s = 
— a + iw (a, co reaZ; a ^ 0; co f^ 0), i/ien a ^ a • 

Lemma 8: Let F(-) fee a totfice differentiable n-vector-valued function de- 
fined on [ — f, oo ), in which f = max, v ,- \th\, such that 

F + CF + AF = 0, t^O. 

Let A(s) have a simple zero at s = 0, and with the exception of this zero 
assume that A (s) ^ /or aZZ Re [s] ^ — a /or so??*e positive constant a . 
Then there exist a constant n-vector K, positive constants /3 and 7, and an 
n-vector-valued function G(-) defined for t t [0, °°), swc/i that 

I [0(0], I ^ 0<f T ', « ^ 

/or a« *, and F(J) = 0(0 + K /or oiZ 1 ^ 0. 

Lemma 4- II F(t) = 0(0 + -K satisfies 

F + CF + AF = 9, t^O 

with G{t) -^ 6 as t-^> «, a?id X a constant vector, then, for some constant p, 

K = P (l, 1, ■■• ,l)' r . 

Proo/ 0/ Lemma 1 : The determinant A (s) is analytic throughout the 
s-plane. It can be written as some power series 

71-0 

which converges for all s. Since A(0) = det A = 0, £ = 0. To prove 
Lemma 1, it suffices to show that 

Urn ^ X 0, 

for then £, 5^ 0. We show this as follows. 

We write s _1 det [s 2 l„ + sC + A] as det M in which 

M = diag (s 2 + c x s, s 2 + c 2 s, • • • , s 2 + Cn-18, s + c n ) + A' 

where A' is obtained from A by dividing each element of the nth row 
of A by s. But, with M (n,n) the submatrix obtained from M by deleting 
the nth row and column, 

det M = (s + c) det M (n,n) + s" 1 det P 

in which 
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P = A -f- diag (s 2 + CiS, s 2 + c 2 s, • • • , s 2 + c„_iS, 0). 
Since, by assumption, det A ln,n) > 0, we have 

< lim(s +c n )detM" (n ' n) . 

«— 

The determinant of P is an analytic function of s for all s. For s = 0, 
it vanishes. Therefore its power-series expansion at s = is of the form 

n=l 

We note that for s real and positive, det P > because for s real and 
positive P is strongly dominant in its first (n — 1) rows and at least 
weakly dominant in its last row.* Thus pi is not negative, and 

lims -1 detP ^ 0. 

i— 

Therefore 

lim s _1 det [s 2 l n + sC + A] > 0. □ 

i— 

Proof of Lemma 2: If s is such that A(s) = 0, then there exists a 
nonzero complex n- vector x such that 

(s 2 l„ + sC + I)x = 6 

and consequently 

x*(s 2 l n + sC + A)x = 0. 

With 1 H = |(1 -f- A*) and A s = ±(A - A*), we have 

S II FF II ■■ ||2 + || ■ ||2 " (20) 

in which || x || = (x*x) , 

(Z ff )i,- = — £a,-,[exp (— st,,-) + exp (— s*t,-,)], for all i 7^ 3 
(A„)ii = 2 a a . for all t 

and 

(1. 5 ) 1; - = -|a,,[exp (— *t„) - exp (-s*t,,)], for all i ^ j 

(A s ) a = 0, for all i. 



* In other words, for such values of s, det P > because (for each such value 
of s) there exists a diagonal matrix D = diagd, 1, . . ., k) with k > 1 such that 
PD is strongly row-sum dominant. 
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Notice that both A H and (i)~ l A s [i = (— 1)* when not used as an index] 
are hermitian matrices, and that 

X JLrtX j X A. sX 

71 — rj2 and Tj [T2 

II ^ || ||x|| 

are real and pure imaginary, respectively. 

Sublemma 1: If A (s) = with s = a + ico and a ^ 0, then 

o> 2 ^ a + a min c, . (21) 



Proof: From 



2 . X L>X . X A.jjX . X AgX A /oo\ 

S + S Tj ^2 + II I 112 + I. .. 112 = (22) 



for some nonzero x corresponding to the assumed value of s = a + tw, 
we have 

2 2 i ^ CiC . .X AjjX n 

o: — a; + a tj rrg + rj 172 = U. 

1 1 a; 1 1 11*11 

But for a ^ 0, Z is both at least weakly row-sum dominant and weakly 
column-sum dominant. Thus & H is at least weakly dominant and hence 
nonnegative definite (that is, x*A H x £: 0). Therefore 

2 2 i 2» ^ / ^ 

co ^ a -f- a 



,. * II 
^ a 2 + a min c< . □ 



Sublemma 2: If 



c< > 2 a <> max ( T >'» » r »»") 

/or all i, then A (s) 5^ for Re [s] > 0. 

Proof: Sublemma 1 implies that A(s) has no zeros on the positive-real 
axis. Assume now that s = a + iw with a > and ^ 0. Then, using 
equation (20), 

„ . .a; Cx . x AgX „ 
2alw + tw rj JT2 + 71 172 = O 



or 



x*Ca! . g*[(icj)" 1 l a ]a; _ 



2« + fP^2 + ~ V nr^ = 0. (23) 

•t ; 1 1 •** II 
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Let ?n,y denote the ijth element of (*w) -1 J. a . Then m,-, = for all i, 
and for i 5^ j: 

m ti = — %a ii (iu>)~ 1 [exp (— ar it ) exp (— war,-,-) — exp (— qit,-,-) exp (icor,-,)] 
= — \a {i exp (— aT,-y)(?&j) _1 [exp (— iwr,-,-) — exp (z«t,-,)] 

-f- la w (*w) -1 [exp (— ATfi) exp (iwT,-,-) — exp (— ar,-,) exp (wot,-,-)] 
= a,,- exp (-aTn) exp [mKtu - r.-^Kco) -1 sin ft( T « + t,-,)co] 

+ Ja,i exp (twT l -,-)(%))~ 1 [exp (-«t,-,) — exp (— ar,-,)]. 
It follows that 

| m tl | ^ a,- ,-$(*■,•/ + Ta) + §a„- | w -1 [exp (— ar it ) - exp (-ar,-,)] |. 
But, from inequality (21), ai 2 ^ a 2 , so that 
I w _1 [exp (— crr/f) - exp (-ar,,)] | 

^ | a _1 [exp (—ctTa) - exp (-ar,,-)] | 
and, as can easily be verified, 

| of x [exp (— «t,-,) — exp ( — ar,-,-)] | ^ | r,-,- — t,-, |. 
Therefore, for i ^ j, 

I ^.-> I ^ a«}(r<* + t,-,) + a,-,-! | t,-,- — T ti | = a,,- max (t,-,- , t,-,). 
However, by the hypothesis of the sublemma, 

Ci > 2 a a max (fn ) T a) 

for all i, and thus C + (iu>)~ l A s is a strongly-dominant hermitian 
matrix. This means that C + (iu>)~ 1 A s is positive definite, and hence 
that a in equation (23) is negative, which is a contradiction. □ 

Sublemma 3: If b x , b 2 , ■ • ■ , b„ are positive constants such that 

for all i, then there exists a positive constant a with the property that if 
c, ^ bi for all i, and if A(s) =0 with s = a -j- iu and a ^ and u j* 0, 
then a > a. 

Proof: With s = a + ia and a ^ and u^O, and proceeding as in 
the proof of Sublemma 2, with any C such that c,- ^ &,• for all i we have 
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for some nonzero vector x 

. x*Cx , x*Mx _ _ 

40L + 7] TT2 T II „ 112 — U 

II &|l II * || 

in which il/ is hermitian with elements m,, = for all i and m,-, (t ^ ;') 
such that 

| m ti | ^ 0«i(r<, + r,-,) + |o i( - | w _1 [exp (-ar,-,) - exp (-ar,-,-)] |. 

By Sublemma 1, 



0> 



2 ^ a 2 + a& 



in which b = min,- 6,- . Thus | u | _1 ^ (a 2 + a&) *■ Since (for all a ^ 0) 

| exp ( — ar,-,-) — exp (— ar,-,-) | ^ a | t,,- — r,,- |, 

we have (for all i ^ j) 

| ra,,- | ^ Oh\(tu + t,-,) + ^a,-,-a(a 2 + a6) _i | t,-,- — t,-,- |. 

Let 

c = min [bi — 2 a «»l( T <j + T »«)l- 

Of course c > 0. Since 6 > 0, it is clear that there exists a positive con- 
stant a such that (for all i ^ j) 

{2n)~ 1 e ^ \a ti a{a + ab)~ h | r,-,- - r,-,- | 

for all ^ a ^ a. It follows that (C + M) is positive definite for all a 
such that ^ a ^ <r. This means that if a ^ satisfies equation (23), 
then a > a. □ 

Sublemma 4: There exists a positive constant k, independent of C, such 
that ij A (s) =0 with s = a + «a> and a ^ 0, then 

| s | < max c { + fc. 
< 

Proof: The elements of A are uniformly bounded on Re [s] ^ 0. 
Let k be any positive constant greater than 

sup { Ij^m * : Re [s] g 0, x * d\- 
U II * II J 

If A (s) = with 8 = a + ita and a ^ 0, then for some x ^ 6 
2 . x*Cx . x*Ax _ 

s +s IMf + IMf " 
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and 



9 X*CX 

2s = — 7i ri2 ± 



L\||*||V 



- 4 



x*Ax 



Thus, since 

I [7 x*Cx V . x*Ax 1 J 

it follows that 



lP^ + 2 



x*Ax 



S ^ II .. ||2 + 



x*Ax 



^ max c, + k. □ 



By Sublemmas 1 and 3, if 



:.• > £ a,,Kr,-,- + r,-,) 



(24) 



for all i, then A (s) has no zeros on the positive-real axis of the s plane, 

and A (iu>) ?* for all real u^O. We are now in a position to show that 

if condition (24) is satisfied for all i, then A(s) 9^ for Re [s] > 0. 

Let §i for i = 1, 2, • • • , n be any set of positive constants such that 



for all *, and let c, for i = 1, 2, 
such that c, ^ c,- and 



, n be any set of positive constants 



c, > 2 a a max ( T w i '"i*) 

for all t. Let c, c [c,- , c,] for all i. Then, by Sublemmas 3 and 4 there 
exists a "half- moon-shaped" finite region (R in the strict right-half 
plane bounded by a line Re [s] = a and a semicircular arc | s | ^ K 
such that if c, e [c, , c,] for all i and A(s) = with Re [s] > 0, then s 
lies inside (R. By Sublemma 2, for c, =c,- for all i, A(s) 5^ for Re [s] > 0. 
On the boundary of (R, A (s) 5^ for all c, e [c,- , c,]. 

For each », we can write A(s) as A t (s) + CiB { (s) in which A, and 5, 
are entire functions which are independent of c,- . For c,- = c, for 
i = 2, 3, • • • , n 

A x (s) + c,5,(s) 5* 



on the boundary of (R for all C! e [cj , ffj. Thus A(s) has no zeros inside 
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(R for c, = Qi and c,- = c, for i = 2, 3, • • • , n* Similarly, for c, = c x and 
c, = c, for t = 3, 4, • • • , n 

A 2 (s) + c 2 B 2 (s) ^ 

on the boundary of (R for all c 2 e [c 2 , c 2 ]. Therefore A(s) has no zeros 
inside (R for Cj = c, , c 2 = c 2 and c,- = c, for z = 3, 4, • ■ • , n. By con- 
tinuing in this manner we find that A(s) has no zeros inside (R when 
c. = c, for all i, which shows that if condition (24) is satisfied for all i, 
then A(s) ^ for Re [s] > 0. 

The following argument completes the proof of Lemma 2. 

If A(s) =0 with s = — a + to, then for some a: ^ 

2 2 £*Cz , x*A a x 



a — a; — a 



+ rr^fri = o. 



Since A(s) is an entire function of s, in any circle in the s plane A(s) 
has at most a finite number of zeros. Thus, either there exists a positive 
constant a such that if A (s) =0 with s = — a + z'co and a > 0, then 
a 2> a , or there exists an infinite sequence Sj , s 2 , • • • , such that 
A(s n ) = for all n and, with s n = — a n + *w„ ,u„-> M and a n — > 0+ 
as n — > oo . In the later case, since for ?i = 1,2, 

2 2 Z^CZn X%AgXn 

w„ = a n — a„ Tj T[2 "Tii , I [2 
with x n 7^ 6 an associate of s„ , we would have 

an_an TM? + lRF"" co 

as a„ — * 0+ which is impossible since for any real /3 < 

II II 2 

is bounded on the strip ^ Re [s] ^ uniformly in x n . D 
Proo/ of Lemma 8: We have 

F + CF + AF = 6, t^ 0. (25) 



* Here we use the following known result. 8 Let (R be a closed region in the s plane, 
the boundary of which consists of a finite number of regular arcs; let the functions 
/(s) and h{s) be regular on (R. Assume that for no value of the real parameter c, 
running through the interval a < c < b, does the function /(s) + ch(s) become 
equal to on the boundary of (R. Then the number N(c) of the zeros of /(s) + ch(s) 
inside (R is independent of c for a < c < b. 
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Using the Bellman-Gronwall Lemma (see p. 31 of Ref. 7), we can prove 
that there are constants k x , k 2 > such that for all i 

I FS) | ^ h exp (k 2 t), t ^ 0. 

Thus F(-) possesses a Laplace transform 

(" F(t)e-" dt ± F(s) 

which is well defined for all s such that Re [s] > k 2 . Therefore 
s 2 F(s) + sCF(s) + 1F0) = sF, + V 2 + W(s) 

in which the constant vectors Vi and F 2 take into account the values 
of F(0) and F(0), and for all i 

[Wis)], = £ a,-,- exp (-«■«,) f FMe"' dt. 

i*i J -Tij 



Thus 



F(s) = [s 2 l„ + sC + i]" 1 ^ + V 2 + TF(s)]. 



Of course 



F(<) = (27TJ)" 1 f ^(s)e" ds, * ^ 

in which (l-\-) is some line parallel to and to the right of the imaginary 
axis of the s plane. Let (I— ) denote the line indicated in Fig. 1. Then 



Im [s] 
i 



-6 a , + I p 



Rets) 



,1-) 



1+) 



Jr- 



». h ft -I 






/? > 
a,, a 2 > 



Fig. 1 — Relation between (I — ) and (£+). 
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(see Fig. 1) 

/ - lim / 

•'(J + ) fl-*oo "ax— ip 



and for t > 



+ / +/ + i =K 

in which K is a constant n-vector (since the contour contains 
a single pole at the origin). Since the integrand — * 6 uniformly in — a 2 Z* 
Re [s] ^ «! as | Im [s] | — > co , the integrals over the horizontal pieces 

— > as /3 — » co , and therefore for i ^ 

= £ - lim / 



We now show that 

lim 



/-a, -if 



exponentially as £ — > co . 

On (Z— ) each element of W(s) is bounded. Thus on (I—) each ele- 
ment of 

Q(s) 4 [l nS 2 + sC + 1] _1 [F 2 + fT(a)] 

(we consider the part involving V x later) is bounded and of order at 
most | s | -2 as | s | — > co . Therefore 

/ Q(s)e" ds = exp (-a 2 t) lim / Q(-a 2 + iw)e <at d{iu) 

J 11-) P-*> JiP 

But fjj* is uniformly bounded on the t-set [0, co), and hence 

Q(s)e" ds 



L 



'(»-) 

approaches zero exponentially. 
Consider now the integral 



f [l n s 2 + sC + l] _1 sTV ds. 



We cannot directly apply the same argument as for the integration of 
Q because here it need not be true that on (I—) each component of the 
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integrand is of order at most \ s\~ as [ s | — » « . However, if on (I— ) some 
component #,(s) of [l„s 2 + sC + ^J'^F, is not of order at most | s |" 
as I s I — > oo , then it can be written (to within a constant multplier) as 



ff.-GO - - 



2n-lv(2"-D I 2n-22(2n-2) I . . . _|_ v<°> 



s + Us) 



in which s 2 "£d(s) — > as | s | — > oo on (I—), and S (2n °i 
^(2n-2)^ ... t ^T (0) denote sums of exponentials (some sums may be 
constants). Thus the sum of Ri(s) and 

^>(2n-l) 

(cr > a ) 



s + a 



is of order at most \s\ 2 as | s | — > <*> on (Z— ). Since the inverse Laplace 
transform of 



,(2n-l) 



vanishes faster than some damped exponential, we see that 

[ [l n s 2 +sC + A]~ 1 sV 1 e" ds, t^O 

can be written as the sum of two integrals, the components of both of 
which approach zero at least as fast as some damped exponential. □ 

Proof of Lemma 4- Since F(-) satisfies 

F + CF + AF = 6, t^ 

we have 

F(t) = e- cl F(0) - f e" C( '- rl (4F)(r) dr, t ^ 0. 

But F(t) -> K as t -» oo . Therefore as * -> » , 

-Tty) -* lim f e _C(| - T> AK" dr = C~ l AK. 

I— oo •'0 

In addition, since 

F(<) = f F(t) dt + F(0), f ^ 

^o 

we see that — C~ l AK [that is, the limit of F(t) as t — > °o] must be the 
zero vector, for otherwise F(Z) could not approach a constant vector as 
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t -> oo . Thus AK = d. We note that A (1, 1, ■ ■ ■ , l) tr = d, and that A is 
of rank (n — 1). Therefore K = p(l, 1, • • • , l)' r for some constant p. □ 

3.2 Proof of Theorem 2 

By Lemma 2 of the proof of Theorem 1, A(s) ^ for Re [s] ^ 
and s 9^ 0. Let A(s) = with s = — a + *«, a > 0, and co ?»* 0. Then 
for some x j* 

o • . • 3*^3 _i_ X*X a X n 

1 1 * 1 1 1 1 a: 1 1 



o x * Cx j_ ^M"^ _ n 

" + TM? + IMI" 

Let f = max lVl - {r,,}. Then (*'a>) _1 A 5 = e af Z? s with 
(Bs)n = 0, for all * = j 

, . _., sin urn t „ . , . 

= dura exp [aO.-y — t)J , for all * =^ J. 

Thus since | (B B )n | ^ a^Tu for all i ^ ;*, all a > 0, and all a> ^ 0; and 

for all », it follows that 

x*Cx . x*B s x 

± Ti TT2 ^ 6 



II ^ II II x 

for all a > and all u/0. Therefore with 

rc*Cx j , x*B s x 

c ~ Ti — TT2 and o = 71 — [72 , 
II a; II 11*11 

we have 

-2a + c + be" 7 = 

with I b I ^ c — 8 and c ^ max,- c,- . But 

-2a + c ^ I -2a + c | = | b \ e af ^ (c - 8)e af 

and hence 

— 2a + c ^ (c — 5)e aT , c S max c, . 
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Therefore a must not be less than a , the unique solution of 
— 20:0 + maxc, = [max c,- — 8]e"' T . □ 

3.3 Proof of Theorem 3 
We have for all i 

fi = c,(/o.- - /,) + E onhi > * * 

with 

6,,(0 = M - r«) - 1M- 

Observe that 



dt 

du 



f hit - r„) 

Jo 

= [ 1,.(u) du+ I " [JM - p] du + (r - rt^p 

J-Tij JO 

= (t - r ii )p + f /,(«) du + /"" \JM ~ p] 

•'-T.i ^O 

-[[!&)- P ] 



r/?/ 
Since 



U = exp (-c,0/,(0) + f exp [-c,(< - r)] 
Jo 

•[*/« + E «,,&«(*)] dr, / ^ 



for all i, 



/,- = exp (-c,-0/,(0) + f exp [-c,(< - r)]{c,/ 0l - + E a.,&u(0) 

- E «.-,t,-,p + E q m / /,-(") d « + E <*a(Pi - Pi) 

- E «ii[«fi(r) - r,(f)]} dr, C £ (26) 



2020 THE BELL SYSTEM TECHNICAL JOURNAL, JULY-AUGUST 1969 

for all i, in which 

Pi = I U,(u) ~ p] du 

qM = f° ' t [/» - p]du 

r<(r) = £° UM ~ p] du. 

The functions <7,,(t) and t\(t) approach zero as t — > °o. In order that 
the asymptotic values (as t — * <x> ) of both sides of equation (26) agree, 
we must have 

pet = Cifoi + E o.-i&i/(0) - 2 a,,T,-,p 

iVi |Vi 

f,(u) du + E «.»(?»■ - P.) 
for all i. But (using the assumption that a {i = a,-, for all i ^ j) 

E E «.i(pi - p.) = o- 

Therefore 



- p E E «or.,- + E E «./ f /#(») d«. d^ 

i j*i i iVi J -rii 



3.4 Proof of Theorem 4 

The following lemma and Lemmas 1, 3, and 4 of the proof of Theorem 
1 prove Theorem 4. 

Lemma 2': If 

c, ^ (2 E «.,)* for all i, 

i*i 

then there exists a positive constant a such that A(s) =0 and s?^0 imply 

that Re [s] ^ — a . 

Proof of Lemma 2': With D = diag iE»v> a n\ and •£' = •£- Ai , 



* The last part of this proof, which involves the observation that the double 
sum is zero, is similar to an argument used by Brilliant (see the appendix of 
Ref. 5). 
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A(s) = det [lj +sC + 1] 

= det [l„s 2 + sC + A, + A'] 

= det [l„s 2 + sC + D ]-det [l n + (l n s 2 + sC + Do)" 1 !']. 

The diagonal elements of D are positive. It is therefore clear that 
there is a positive constant a' Q such that if det [l n s 2 + sC -f- 2) ] = 0, 
then Re [s] ^ -<*£ . It is also clear that det [1„ + (l„s 2 + sC + D )~ l A'\ 
is not zero for all s such that Re [s] ^ and 

| (s 2 + sc,. + 2 O -1 E «.-• I < 1 for all », (27) 

since for those values of s the matrix [1„ + (l n s 2 + sC + D,,) -1 ^'] is 
strongly row-sum dominant. 
By assumption, 

Ci ^ (2 2 <*«)* for all i. 

It is a simple matter to verify that this assumption implies that condition 
(27) is satisfied for all s = io> with w real and u f* 0. Thus A(tw) ^ 
for all co 9^ 0. But for all i 

(s 2 + sc, + 2 a w) _1 E «« 
is analytic throughout the closed right-half s plane, and 
| (s 2 -I- sc- + E «o) _1 E «.,- I ^ 1 

for all j and for all s = iu. By the Maximum Modulus Theorem, condition 
(27) is satisfied for all s such that Re [s] > 0.* Therefore A(s) ^ 
for all s ^0 such that Re [s] ^ 0. Finally, the argument used to prove 
the last part of Lemma 2 shows that there exists a positive constant a 
such that if A(s) =0 with s^0, then Re [s] ^ — a . O 

APPENDIX 

Left-Half- Plane Zeros of det [I - B(s)] 

We wish to show here that all of the left-half-plane zeros of 
det [/ — 5(s)], in which I — B(s) is as defined in Ref. 3, lie to the left 
of some line which is parallel to and lies to the left of the imaginary 
axis of the complex s plane, provided that each Hi(s), which enters into 
the definition of B(s), is a meromorphic function of s such that there 



* This type of argument is also used in Ref. 3. 
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exist positive constants o\ and K { with the property that | ff,(s) | ^ K { 
for aU s with -cr, ^ Re [s] < 0. 

Assume that what we wish to prove is false. Then, as in the proof of the 
last part of Lemma 2, there would exist a sequence S = {s*}" such that 
Re [s k ] < for all A;, Re [s k ] -> as k -> » , Im [s k ] — > «> as k -^ «> , 
and det [/ - B(s k )] = for all k ^ 0. But the complex numbers a it 
of Ref. 3 are bounded on S and Hi(s k )[s k + i/.O*)] -1 — > as k -> ». 
This means (see Ref. 3) that there is a positive number k' such that the 
matrix [/ — B(s k )] is strongly dominant for all A; ^ k', which contradicts 
the assumption that det [I - B(s k )] = for all k ^ 0, and proves that 
our assertion is true. 
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